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Abstract 

The method of periodic projections consists in iterating projections onto m closed convex 
subsets of a Hilbert space according to a periodic sweeping strategy. In the presence of m > 3 
sets, a long-standing question going back to the 1960s is whether the limit cycles obtained 
by such a process can be characterized as the minimizers of a certain functional. In this 
paper we answer this question in the negative. Projection algorithms that minimize smooth 
convex functions over a product of convex sets are also discussed. 
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1 Introduction 



Throughout this paper 7i is a real Hilbert space with scalar product (• | •) and associated norm 
II ■ II . Let Ci and C2 be closed vector subspaces of H, and let Pi and P2 be their respective 
projection operators. The method of alternating projections for finding the projection of a point 
xq £ Ti onto Ci n C2 is governed by the iterations 



(Vn G N) 



X2n+1 — P2X2n ^-^ 
X2n+2 = PlX2n+l- 



This basic process, which can be traced back to Schwarz' alternating method in partial differ- 
ential equations has found many applications in mathematics and in the applied sciences; 
see [12] and the references therein. The strong convergence of the sequence {xn)n€M produced 
by p.ip to the projection of xq onto Ci PI C2 was established by von Neumann in 1933 [22] . 
The extension of (jl.ip to the case when Ci and C2 are general nonempty closed convex sets was 
considered in [3119]. Thus, it was shown in [7] that, if Ci is compact, the sequences (x2n)neN and 
(x2n+i)nGN produccd by (jl.ip converge strongly to points and respectively, that constitute 
a cycle, i.e., 

yi=Piy2 and y2 = -P2yi, (1-2) 
or, equivalently, that solve the variational problem (see Figured]) 

minimize ||yi— y2||- (1-3) 
'/ieCi,s/2eC2 

Furthermore, it was shown in [19] that, if Ci is merely bounded, the same conclusion holds 
provided strong convergence is replaced by weak convergence. As was proved only recently [17] . 
strong convergence can fail. 

Extending the above results to m > 3 nonempty closed convex subsets (Ci)i<j<m of % poses 
interesting challenges. For instance, there are many strategies for scheduling the order in which 
the sets are projected onto. The simplest one corresponds to a periodic activation of the sets, 
say 

Xmn+l — PmXmn 
Xmn+2 — Pm—lXmn+l 

(1-4) 



(Vn e N) 



where {Pi)i<i<m denote the respective projection operators onto the sets (Cj)i<j<m- In the 
case of closed vector subspaces, it was shown in 1962 that the sequence (x„)„gN thus generated 
converges strongly to the projection of xq onto HI^i L16J- This provides a precise extension 
of the von Neumann result, which corresponds to m = 2. Interestingly, however, for nonperiodic 
sweeping strategies with closed vector subspaces, only weak convergence has been established in 
general [1] and, since 1965, it has remained an open problem whether strong convergence holds 
(see [2] for the state-of-the-art on this conjecture). Another long-standing open problem is the 
one that we address in this paper and which concerns the asymptotic behavior of the periodic 
projection algorithm (|1.4p for general closed convex sets. It was shown in 1967 [15] (see also [101 
Section 7], [H], and [20, Theoreme 5.5.2] for extensions of this result to more general operators) 
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Figure 1: In the case of m = 2 sets, the method of alternating projections produces a cycle 
(^1)^2) that achieves the minimal distance between the two sets. 



that, if one of the sets is bounded, the sequences {xmn)nm, {xmn+i)n€N, {xmn+m-i)n€hi 
converge weakly to points Iji, . . . ,y2, respectively, that constitute a cycle, i.e. (see Figure [2]), 

Vl = Piy2, • • • , Vm-l = Pm-iym, Vm = PmVl- (1-5) 

However, it remains an open question whether, as in the case of m = 2 sets, the cycles can be 
characterized as the solutions to a variational problem. We formally formulate this problem as 
follows. 

Definition 1.1 Let m be an integer at least equal to 2 and let (Ci , . . . , Cm) be an ordered family 
of nonempty closed convex subsets of Ti with associated projection operators (Pi, . . . , Pm)- The 
set of cycles associated with (Ci, . . . , Cm) is 

Cyc(Ci,. . .,Cm) = {{Vl,-- ■ ,ym) e ^"^ I yi = Piy2, . . . , Vm^l = Pm-lVmi Vm = PmlJl] ■ (1-6) 

Question 1.2 Let m be an integer at least equal to 3. Does there exist a function <I>: T-C^ 
M such that, for every ordered family of nonempty closed convex subsets (Ci, . . . , Cm) of %, 
cyc(Ci, . . . , Cm) is the set of solutions to the variational problem 

minimize $(yi, ...,?/„)? (1.7) 

yiGGi,..., ?;mSCm 

Let us note that the motivations behind Question 11.21 are not purely theoretical but also 
quite practical. Indeed, the variational properties of the cycles when m = 2 have led to fruitful 
applications, e.g., [TH [211 123 IHI- Since the method of periodic projections (II. 4p is used in 
scenarios involving m > 3 possibly nonintersecting sets [8], it is therefore important to under- 
stand the properties of its limit cycles and, in particular, whether they are optimal in some 
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Figure 2: Example with m = 3 sets: the method of periodic projections initiahzed at xq produces 
the cycle {y^,!]^,!]^). 



sense. Since the seminal work [15j in 1967 that first established the existence of cycles, little 
progress has been made towards this goal beyond the observation that simple candidates such 

as (yi, ...,ym) ^ Wvi - y2\\ H h \\ym-i - VrnW + hm - yiW fail H El m dS]. The main 

result of this paper is that the answer to Question 11.21 is actually negative. This result will 
be established in Section [2j Finally, in Section [3l projection algorithms that are pertinent to 
extensions of (jl.3p to m > 3 sets will be discussed. 

2 A negative answer to Question 11.21 

We denote by S{x;p) the sphere of center x £ H and radius p G [0,+oo[, and by Pc the 
projection operator onto a nonempty closed convex set C C "H; in particular, PcO is the element 
of minimal norm in C. 

Our main result hinges on the following variational property, which is of interest in its own 
right. 

Theorem 2.1 Suppose that dimTi > 2 and let ip : H ^ M be such that its infimum on every 
nonempty closed convex set C cH is attained at PcO. Then the following hold. 

(i) ip is radially increasing, i.e., 

(Vx G n){yy G n) \\x\\ < \\y\\ ip{x) < <f{y). (2.1) 
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Figure 3: A polygonal spiral from y = Xnfl to Xn,n in V- 

(ii) Suppose that, for every nonempty closed convex set C C TL, PcO is the unique minimizer 
of If on C. Then (p is strictly radially increasing, i.e., 

(Vx G 'H){\ly € 'H) \\x\\ < \\y\\ => ip{x) < ip{y). (2.2) 

(iii) Except for at most countably many values of p £ [0, +oo[, if is constant on S{0; p). 



Proof, (i) Let us fix x and y inH such that < ||y||. If x = 0, property (|2.ip amounts to the 
fact that is a global minimizer of ip, which follows from the assumption with C = %. We now 
suppose that x 7^ 0. Let F be a 2-dimensional vector subspace of % containing x and y, and let 
a G [0, tt] be the angle between x and y. For every integer n > 3, consider a polygonal spiral built 
as follows: set Xnfi = y and for /c = 1, . . . , n define Xn,k = PR„^kXn,k-i, where {Rn,k)i<k<n are n 
angularly equispaced rays in V between the rays [0, +oo[y and [0, +oo[x = Rn,n (see Figure [3|). 
Clearly, for the segment C = [xn,k-i,Xn,k], we have PcO = Xn^k-, so that the assumption on 
tp gives ip{xn,k) < <^(a^n,fc-i)i and therefore '~p{xn,n) < ^{xnfl) = V'(y)- On the other hand, 
Xn,n and X are collinear with ||xn,,n|| = ||y||(cos(a/n))" so that for n large enough we have 
1 1 2;n,n II > \\x\\ and, therefore, the segment C = [ X, Xn,n\ satisfies -PcO — x, from which we get 
(p{x) < Lp{xn,n) < ^{u) as claimed. 



(ii) If the minimizer of p) on every nonempty closed convex set C C Ti is unique, then all 



the inequalities above are strict. 



m 



Set g: [0,+oo[ ^ R: p ^ miip{S{0;p)) and h: [0,+oo[ R: p ^ sup (^(5(0; p)). It 



follows from (|2.ip that 

(Vp e [0, +oo[)(Vp' e [0, +oo[) p<p' ^ g{p) < h{p) < g{p') < h{p'). (2.3) 
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Hence, g and h are increasing and therefore, by Froda's theorem [251 Theorem 4.30], the set of 
points at which they are discontinuous is at most countable. Since g and h coincide at every 
point of continuity, we conclude that, except for at most countably many p € [0,+oo[, is 
constant on 5(0; p). □ 

As a straightforward consequence, we get the following. 

Corollary 2.2 Suppose that dim 7^ > 2 and let ip : 7i M be such that its infimum on every 
nonempty closed convex set C cH is attained at PcO. If if is either lower or upper semicontin- 
uous, then 99 = || • ||, where 9: [0, +oo[ — )• M is increasing. Furthermore, if PcO is the unique 
minimizer of (p on every nonempty closed convex set C cTi, then 6 is strictly increasing. 



Using Theorem 12.11 we can provide the following answer to Question 11.21 

Theorem 2.3 Suppose that dim'H > 2 and let m he an integer at least equal to 3. There exists 
no function <I> : T-L^ — t- M such that, for every ordered family of nonempty closed convex subsets 
(Ci, . . . , Cm) of T-L, cyc(Ci, . . . , Cm) is the set of solutions to the variational problem 

minimize . . . , y^). (2.4) 



Proof. Suppose that $ exists and set (Vi G {1, . . . , m — 2}) Ci = {0}. Moreover, take z & V. and 
set Cm-i = {z}. Then, for every nonempty closed convex set Cm C 7i we have 

Argmin $(yi, . . . , y„) = cyc(Ci, . . . , C^) = {(0, . . . , 0, z, Pc^O)}. (2.5) 

m 

Hence, Theorem 12.11 implies that, except for at most countably many values of p G [0, +cxd[, the 
function $(0, . . . , 0, z, •) is constant on S{0; p). 

Now suppose that z G ^(O; 1) and take p G ]l,+oo[ so that $(0, . . . , 0, z, •) and 
^>(0, . . . , 0, —z, ■) are constant on 5(0; p). Clearly, 

cyc({0}, . . . , {0}, [-Z, z], {pz}) = {(0, . . . , 0, z, pz)} (2.6) 

and 

cyc({0}, . . . , {0}, [-Z, z], {-pz}) = {(0, . . . , 0, -z, -pz)}, (2.7) 

so that 



$(0, ...,Q,z,pz) < $(0, . . . , 0, -z, pz) 
= «>(0,...,0,-z,-/>z) 

< «>(0,...,0,Z,-/9Z) 

= ^Q,...,0,z,pz) (2.8) 

where the inequalities come from the fact that the minima of <1> characterize the cycles, while the 
equalities follow from the constancy of the functions on 5(0; p). Since these strict inequalities 
are impossible it follows that $ cannot exist. □ 
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3 Related projection algorithms 



We have shown that the cycles produced by the method of cychc projections (jl.4p are not 
characterized as the solutions to a problem of the type (jl.7p . irrespective of the choice of the 
function M. Nonetheless, alternative projection methods can be devised to solve 

variational problems over a product of closed convex sets. Here is an example. 

Theorem 3.1 For every i € I = {1, . . . ,m}, let {Tii, \\ ■ be a real Hilbert space and let d he 
a nonempty closed convex subset ofHi with projection operator Pi. Let H be the Hilbert space 

obtained by endowing Xjg/'Hi with the norm y = {yi)ii=i i-> \J^i(zi WViWi, o,nd /et ^ ^ M 
be a differentiable convex function such that V<1>: H ^ H : y ^ {Giy)i£i is 1/ fi-lipschitzian for 
some j3 € ]0, +(X)[ and such that the problem 

minimize ...,ym) (3.1) 

J/16C1,..., ymGCm 

admits at least one solution. Letj € ]0, 2/3[, set 6 = min{l, /3/7} + l/2, let (A„)„gN be a sequence 
in [0,5] such that X]neN'^"('^ ~ ^n) = +00, and let xq = (xj^o)ie-r ^ Set 

iyn G N)(Vi e /) Xi^n+l = Xi^n + A„(Pi(xj,„ - 'jGiXn) - Xi^n)- (3.2) 

Then, for every i G I, {xi^n)neN converges weakly to a point y^ € Ci, and iyi)i£i is a solution to 



Proof. Set C = X.i^jCi. Then C is a nonempty closed convex subset of H with projection 
operator Pc '- x {PiXi)i^i [6, Proposition 28.3]. Accordingly, we can rewrite (|3.2p as 

(Vn G N) Xn+l =Xn + Xn [Pc {Xn " 7V$(iC„)) - Xn) ■ (3.3) 

It follows from [6^, Corollary 27.10] that {xn)n&i converges weakly to a minimizer ^ of <I> over 
C, which concludes the proof. □ 

The projection algorithm described in the next result solves an extension of (|1.3p to m > 3 
sets. 

Corollary 3.2 Let m be an integer at least equal to 3. For every i G I = {1, . . . ,m}, let d be 
a nonempty closed convex subset of Ti with projection operator Pi, and let Xi^ € %. Suppose 
that one of the sets in {Ci)i^i is bounded and set 



(Vn G N)(Vi G I) Xi^n+i = Pi -^^—^ • ^^'^^ 

Then for every i G I, {xi^n)neN converges weakly to a point y^ G Ci, and {yi)iei is a solution to 
the variational problem 

minimize V \\yi-yjf. (3.5) 
yi&Ci,...,ym&Cm ^ — ' ^ 

i<j 

Moreover, y = (l/m) YlieiVi ^■^ minimizer of the function : 'H — )• M : y i-> Yliei Wv ~ PiVW'^ ■ 
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Proof. We use the notation of Theorem 13. H with (Vi G I) Hi = H. Set /3 = 1 — l/m,7 = l, 



^■.n^M: iyi)i^i^ ^ V Wvi-yjf, (3.6) 
2{m — 1 ^-^ 

Kj 

C= Xi^jCi, iind D = {{y,...,y) en \yen}. Then [SE] 

FixPc^D = Argmin<I> and FixPoPc = {(?/) • • • )?/) | 2/ ^ Argminc/?}. (3.7) 

Since one of the sets in (Cj).jg/ is bounded, Argmimp ^ [9, Proposition 7]. Now let y £ 
Argmin(/9, and set y = {y,. . . ,y) and x = PcU- Then (j3.7p yields y = PdPcU and therefore 
a; = PciPoPcy) = PcPdx. Hence x € Argmin<I> and thus Argmin<l> ^ 0. On the other 
hand, (j3.5p is a special case of (j3.ip and the gradient of <I> is the continuous linear operator 



^1 ^ 



with norm mj (m — 1) = 1//3. Note that, since m > 2, 2/3 > 1 = 7. Moreover, 5 = min{l, /3/7} + 
l/2 > 1. Thus, upon setting, for every n G N, A„ = 1 G ]0, (5[ in (j3.2p . we obtain (j3.4p and observe 
that X^„gNA„((5 — A„) = +00. Altogether, the convergence result follows from Theorem 13. 1[ 
Finally, set ^ = (y^^, . . . , y^) and z = PdV- Then (13. 7p yields 

{y,...,y) = z = PdV = PDiPcPoy) = PdPcz (3.9) 

and hence y G Argmin if. □ 

Remark 3.3 Alternative projection schemes can be derived from Theorem 13.11 For instance, 
Corollary 13.21 remains valid if (j3.4p is replaced by 



(Vn G N)(Vi G /) X^,n+l = P^(^^Y. ^J'" ^ ' (^'^O) 

which amounts to taking 7 = /3 instead of 7 = 1 in the above proof. We then recover a process 
investigated in [H [U [11] . 
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